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TURBO DECODER WITH MODIFIED INPUT 
FOR INCREASED CODE WORD LENGTH 
AND DATA RATE 

CROSS REFERENCE TO RELATED 
APPLICATIONS 

This application claims the benefit of U.S. Provisional 
Application No. 60/132,026, filed Apr. 30, 1999. 

BACKGROUND OF THE INVENTION 

The present invention relates generally to error- correction 
coding and, more particularly, to a decoder for parallel 
convohitional codes, i.e., turbo codes. 

Anew class of forward error control codes, referred to as 
turbo codes, offers significant coding gain for power limited 
communication channels. Turbo codes are generated using 
two or more recursive systematic encoders operating on 
different orderings of the same information bits. A subset of 
the code bits generated by each encoder is transmitted in 
order to maintain bandwidth efficiency. Turbo decoding 
involves an iterative algorithm in which probability esti- 
mates of the information bits that are calculated for one of 
the received component code words are fed back to a 
probability estimator comprising the decoder component 
code words for the other component code words. Each 
iteration of decoder processing generally increases the reli- 
ability of these probability estimates. This process 
continues, cyclically decoding the component code words 
until the probability estimates can be used to make reliable 
decisions. 

The maximum a posteriori (MAP) type algorithm intro- 
duced by Bahl, Cocke, Jelinek, and Raviv in "Optimal 
Decoding of Linear Codes for Minimizing Symbol Error 
Rate", IEEE Transactions on Information Theory, Mar. 
1974, pp. 284-287, is particularly useful as a component 
decoder in decoding parallel concatenated convohitional 
codes, i.e., turbo codes. The MAP algorithm is used in the 
turbo decoder to generate a posteriori probability estimates 
of the information bits that have been encoded into the code 
word. These probability estimates are used as a priori bit 
probabilities for the second MAP decoder. Three fundamen- 
tal terms in the MAP algorithm are the forward and back- 
ward state probability functions (the alpha and beta 
functions, respectively) and the a posteriori transition prob- 
abilities (the sigma functions). 

A known characteristic of turbo codes is that their error 
correction capability increases with code word length. 
However, there is some practical limit on the length of a 
code word that can be decoded with a MAP-algorithm 
decoder implementation. Accordingly, it is desirable to 
provide a modular turbo decoder structure capable of decod- 
ing longer code word lengths. It is furthermore desirable to 
provide such a turbo decoder while increasing coding gain 
and data rate. 

BRIEF SUMMARY OF THE INVENTION 

A turbo decoder system utilizing a MAP decoding algo- 
rithm comprises a predetermined number M of turbo 
decoder modules for decoding segments of a turbo code 
component code word in parallel, thereby expanding the 
block-length and data rate capability of the turbo decoder 
system. In an exemplary system, each turbo decoder module 
has a predetermined maximum code-word size correspond- 
ing to N information bits and a predetermined maximum 
decoding rate. For the first half iteration of the MAP 
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decoding algorithm, the inputted turbo code word 
(corresponding to M*N information bits) is divided into M 
segments, and turbo decoding of these segments is done in 
parallel by the turbo decoders. The resulting a posteriori bit 

5 probability signals are provided to an interleaver/de- 
interleaver-and-convert-data (ICD) block wherein they are 
re-ordered according to the interleaver definition thereof. 
After interleaving, the a posteriori bit probabilities are used 
to modify the values of received data samples. Following 

10 modification of the received data sample values, the modi- 
fied data samples are segmented and provided as input data 
samples corresponding to the bottom component code word 
for the second half iteration of the MAP decoding algorithm. 
At the end of the second half iteration, the output a posteriori 

15 bit probabilities are provided by the component code word 
decoder to the ICD block and re-ordered according to the 
de-interleaver definition therein. After de -interleaving, the 
fed back a posteriori bit probabilities are used to modify the 
values of received data samples to be used in the subsequent 

20 decoding half iteration. Decoding continues in this manner 
until a predetermined number of half iterations are 
performed, and data decisions are made on the final a 
posteriori estimates. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram illustrating a typical turbo 
decoder utilizing a MAP decoding algorithm; 

FIG. 2 is a block diagram illustrating a top level view of 
data flow in a MAP component decoder such as that of FIG. 

30 i. 

FIG. 3 is a block diagram illustrating an exemplary 
embodiment of a turbo decoder system of the present 
invention employing an interleaver/de-interleaver-and- 
convert-data block and multiple turbo decoder modules for 
increasing code word length and data rate capability; and 

FIG. 4 is a block diagram illustrating the data flow, 
interleaving, and code word segmentation used in an exem- 
plary embodiment of a turbo decoder system of the present 
An invention. 

40 

DETAILED DESCRIPTION OF THE 
INVENTION 

A MAP decoder provides estimates of the a posteriori 
45 probabilities of the states and transitions of a Markov source 
through a discrete memory-less channel. The transition 
probabilities of a discrete memory-less channel depend on 
the transitions X* of the Markov source and the observa- 
tions Yj x such that for a sequence, 

50 

' 1 
Pr{Y[\X[) = Y\R{Yj\Xj) 
j-i 

55 where R( # | # ) defines the channel transition probabilities. 
The MAP decoder uses the received sequence Y, T to 
estimate the a posteriori slate and transition probabilities of 
the Markov source. 

6Q Pr{^|r 1 -}-i>r{5 l «m;yr}/Pr{^}-X,(m)/Fr{y^} 2 

and 

65 where S r is the state of the source at time t. 

The alpha, beta and gamma functions defined forth as 
follows: 
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a,(m)>*Pr{Srm;Y t x } 4 

and 

y&n\m)-Pr{S r m;Y t [S,_ t -m'} 6 
so that 

XXm)=o,( W ).pXm) 7 

and 

o,(ffl».a M (m , )'y l (m»^ ( («) 8 

The alpha function can be computed from the following 
recursion: 

<*t (m) = (m') • y, (m' , m). 9 

The beta function can be calculated using the following 
recursion: 

Finally, the gamma function can be calculated as follows: 
y,(m', m) = £ p,(m | m') - * (X | m', m) ■ | X), 11 

where pXm|m') are the transition probabilities of the Markov 
source, and q,(X|m',m)is the distribution of the source's 
output symbols conditioned on the source's state transitions, 
and R(Yt|X) is the channel probability function. 

By way of illustration, the most common case of a turbo 
code comprising two component codes is described herein, 
but it is to be understood that the invention described herein 
applies generally to other turbo codes. For the exemplary 
case, turbo codes are constructed as two recursive systematic 
codes concatenated in parallel. A MAP decoder for a turbo 
code generates a probability estimate of the information bits 
in a component code word, based on one of the two recursive 
systematic codes comprising the turbo code, and provides 
these probability estimates to a second MAP decoder which 
decodes the other component code word of the turbo code 
word. The second decoder uses these probabilities as a priori 
information and generates new probability estimates of the 
information bits encoded in the code word. The updated 
estimates are provided to the first MAP component decoder, 
which, in turn, generates updated estimates. This feedback 
process continues a finite number of times, and a decision on 
the information bits is made based on the final probability 
estimates. Each operation of a component MAP decoder is 
referred to as a half iteration. 

The two parallel component codes in a turbo code are 
referred to herein as the top code and the bottom code. 
Normally, the data is encoded by the top code and is 
interleaved using either a fixed-block interleaver or a ran- 
dom interleaver before being encoded by the bottom code. 

FIG. 1 illustrates a turbo decoder 10 employing compo- 
nent MAP decoders 12 and 14. The inputs to the turbo 
decoder of FIG. 1 are elements of the composite turbo code 
word. The systematic data is a sequence of symbols that 
correspond to the information bits; the top-code parity data 
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are symbols that correspond to the parity bits generated by 
the top component encoder; and the bottom code parity data 
are symbols that correspond to the parity bits generated by 
the bottom component encoder of the turbo encoder. As 

5 shown, the top code parity data is provided along with the 
systematic data to a top code memory 16 and then to MAP 
decoder 12. The systematic data is also provided, via an 
interleaver 18, along with the bottom code parity data to a 
bottom code memory 20 and then to the second MAP 

10 decoder 14. FIG. 1 also shows the feedback loop involving 
MAP decoders 12 and 14, interleaver 18, de-interleaver 22, 
a probability estimate memory 24, and an address generator 
19 for implementing a MAP decoding algorithm as 
described hereinabove. 

15 The systematic (i.e., information) bit probability estimates 
are computed using the a posteriori state transition or 
a/m'^n) probabilities. The sum of all a posteriori transition 
probabilities resulting from the same information bit value is 
the a posteriori probability bit estimate. The output of a 

20 MAP component decoder is an a posteriori probability 
estimate of the information bits, denoted as APP/0) and 
APPXl), as set forth in the following expression: 

APP£k)mPr{drk\Y*}-'Zo<(m' t m) 12 

25 where the summation is over all a/m'^n) values where the 
information bit corresponding to the encoder state transition 
(m 1 , m) is k. 

The calculated a posteriori systematic bit probabilities 
are stored in memory as likelihood ratios, that is, 

30 APP r (l)/APP,(0). 

Although the description herein is given with respect to 
non-logarithmic functions, it is to be understood that a 
logarithmic implementation is preferred for many applica- 
tions. To this end, the mathematical expressions herein may 

35 be converted to logarithmic expressions in known fashion. 
FIG, 2 is a top level view illustrating an exemplary turbo 
decoder data flow structure. The functional blocks within the 
turbo decoder in the data path are the gamma calculator 
block 40, the alpha calculator block 42, the beta calculator 

40 block 44, and the sigma blocks 50. Received symbols 
IPDATA and the a posteriori bit probability estimates from 
the sigma blocks are provided as inputs to the gamma block. 
Four gamma values are outputted from the gamma block, 
one gamma value being provided to each of the alpha and 

45 beta blocks (GAMA and GAMB, respectively); and the 
other gamma values (GAMSR and GAMSL) being provided 
via multiplexers 52 to the sigma blocks along with the 
present alpha and beta values (ASR, 8SL) and the alpha and 
beta values stored in memory (A-MEM and B-MEM). 

50 As illustrated, four sigma blocks 50 calculate the sigma 
values for the state transitions in the trellis. These blocks 
also compute an update of the a posteriori probability 
associated with each of the information (systematic) bits in 
the code word. The probability of the transmitted bit being 

55 zero (AP0R, AP0L) is computed simultaneously with the 
probability of the bit being one (AP1R, AP1L). Since 
symbol-by-symbol MAP decoding involves both forward 
(from the beginning to the end of the received component 
code word) and backward (from the end to the beginning of 

60 the received component code word) recursive calculations, 
as described in U.S. patent application Ser. No. 09/137,260, 
filed Aug. 20, 1998, the turbo decoder processes the received 
symbols comprising the received component code words of 
the received turbo code word sequentially from the first 

65 received to the last received for the forward recursion and 
from the last received symbol to first for the backward 
recursion substantially simultaneously. These operations are 
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performed in parallel in order to minimize the delay which From equation (11), the intrinsic gamma function can be 

would otherwise result from serial sigma block calculations. calculated as follows, assuming a rate Vi component code 

FTC 3 illustrates a turbo decoding system 100 employing word and binary signaling: 
multiple turbo decoder modules, or chips, 102 for decoding 

a code word which exceeds the maximum length each 5 ^ m)= V p , Mm < w , (X |W, », \X) <«) 

respective chip is capable of decoding. By way of example ^ 
only, four turbo decoder modules 102 are illustrated. System 

100 is illustrated as comprising an interleave/de-interleave- -AP^mYi I XMY, I x p \ 
and-convert-data (IDC) block 110 which receives data com- 
prising turbo code words from an analog-to-digital (A/D) . n . AI)/(1V ( , . . . . .... - . , 

converter (not shown). Each turbo code word comprises 10 1S ^ * P non ^P^hty of the bi value d n 

information bits and parity bits. IDC block 110 partitions the * * e probability of receiving the symbol Y, given 

received turbo code words into multiple segments, each that the symbol X, is transmitted, and R(YjX) is probability 

respective segment being provided to a respective decoder of receiving the symbol Y p given that the symbol X p is 

chip 102. For the first half iteration of the turbo decoder transmitted. In this case, the transmitted symbol sequence X 

MAP decoding algorithm, the inputted segments respec- 15 corresponding to an encoder state transition from state m* to 

lively correspond to those required to decode the top com- statc m (caused by bit d f being input to the encoder) is (X fJ 

ponent code word. The turbo decoding of the code word X p ). The corresponding received symbol sequence Y t is (Y„ 

segments for the first half iteration by multiple turbo decoder Yp). Equation (13) suggests that modifying the value of 

chips involves parallel (i.e., simultaneous) decoding of the either of these received symbols appropriately would allow 

respective segments of the turbo code word by the multiple 20 updated a priori bit probability values to affect the calcula- 

chips. Upon completion of the first half iteration of tion of the intrinsic gamma function in each iteration even 

decoding, a posteriori bit probability signals (APP's) are though the component decoder does not provide for them to 

provided to the DC block wherein they are re -ordered be input directly. However, as is taught in U.S. patent 

according to the interleaver definition thereof. The inter- application Sen No. 09/137,260, filed Aug. 20, 1998, a 

leaver (and de-interleaver) length corresponds to the total 25 preferred embodiment of the component MAP decoders 

length of the received composite turbo code word, i.e., calculate the a posteriori bit probabilities (or equivalently 

before segmenting. After interleaving, the a posteriori bit the a posteriori bit likelihood ratios) directly from the 

probabilities are used to modify, or convert, the actual extrinsic gamma function, defined as follows 
received data samples from the A/D converter. Following 

this modification, modified received data sample values are 30 y»W/>I^' C 14 ) 

partitioned into updated received code word segments for 

decoding and provided as input data samples to the appro- ^ out P ut a Posteriori bit probabilities are then used as a 

priate decoder module for the second half iteration of the P riori blt probabilities m the subsequent decoding iteration. 

MAP decoding algorithm. Since Y/(m\rn) is independent of the a prion bit 

Exemplary embodiments of this invention are particularly 35 probabilities, a preferred embodiment of this invention 

useful if the component decoders comprising the turbo modlfies values the received systematic symbols Y, for 

decoder for increased code word length either do not allow each iteration of component code word decoding 

the input of arbitrary a priori bit probabilities or do not allow ^ values of the m P ut data sara P les corresponding to the 

dynamic input of new a priori bit probabilities for each systematic symbols, i.e. received systematic symbols, are 

iteration of component code word decoding. (Throughout 40 modified as a function of the associated a priori bit prob- 

this document, an iteration of component code word decod- abmties according to one of the following preferred embodi- 

ing has been referred to as a "half iteration" for brevity. The ments - In a11 of following, Y, represents the modified 

term originates from the fact that one complete decoding m P ul dala sam P le value corresponding to a systematic 

iteration of a turbo code word requires the decoding of two symbol In one embodiment, the input data samples Y, are 

component code words for the case when the turbo code 45 modified according to the equation 

comprises two component codes. This is an exemplary R ^oyR(rM^o)) ap&Q. 15 
embodiment that has been chosen to describe the invention.) 

The decoding of turbo code words, which exceed the code i n another embodiment, the input data samples Yi are 

word length of the component MAP decoders, requires that modified according to the equation 

the requisite interleaving and de-interleaving functions be 50 

implemented in a module which is external to the MAP Rpfc^Rpfic&ra)) ap(4-i). 16 
decoders. Similarly, some mechanism is required to provide 

the feedback of a posteriori bit probabilities, associated with In y et ano ^ her embodiment, Y, is calculated as the solution 

a code word segment from the subsequent component code tne following equation: 

word to be decoded, to the component decoder which will 55 

decode a given component code word segment in the next /?(ft|0) APi0) t R{Yi\Q) 17 

iteration. In general, these may have been computed by any = AWhWi 1 1) 
or all of the component decoders due to the interleaving that 
is inherent in turbo coding. In preferred embodiments of this 

invention, this feedback is affected by modifying the values 60 where R(X|Y) is the channel probability function used 

of selected input data samples, comprising a received code within each turbo decoder 102, as described hereinabove, 

word segment, for each decoding iteration. The rationale for and AP(X), is the desired a priori symbol probability esti- 

this method can be understood by an inspection of equations mate associated with the systematic data sample Y,. In the 

(1) through (12), which describe the symbol-by-symbol case of binary signaling, the a priori channel symbol prob- 

MAP decoding algorithm. It is evident that the a priori bit 65 ability is the same as the a priori bit probability. In a 

probabilities are only used directly in the calculation of the preferred embodiment, the channel probability function 

intrinsic gamma function values. R(Yt|X) is implemented as a table look-up. 
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Before the start of the second half iteration of the turbo 
decoding MAP decoding algorithm, A/D data samples cor- 
responding to the bottom component code are modified in 
the same manner as described hereinabove and are provided 
to the respective turbo decoder chips 102. At the end of the 5 
second half iteration, the a posteriori outputs (APP's) of the 
individual turbo decoder chips again pass through the IDC 
function block 110 wherein they are again re-ordered, albeit 
this time with the de -interleave r definition. After 
de-interleaving, these values are provided to the respective 
turbo decoder chips according to the segments of the top 
component code (in like manner as the first half iteration), 
used to modify the original A/D samples to which they 
correspond, and provided to the respective turbo decoders 35 
for the third half iteration. In an exemplary embodiment, the 
same decoder chips are used to decode the corresponding 
segments as in the first iteration such that the parity bits 
needed for the third half iteration have already been pro- 
vided thereto and retained in memory. 20 

Upon completion of any half iteration of the MAP turbo 
decoding algorithm, the a posteriori bit probability estimates 
(APP's) are provided to the IDC function block 110, where 
they are re -ordered, segmented, used to modify the original 
A/D data samples, and provided back to the respective turbo 
decoder chips as input data samples for the systematic bits. 
At the end of odd-numbered half iterations, the a posteriori 
probabilities are re-ordered according to the interleaver 
definition, while at the end of even-numbered half iterations, 3Q 
they are re-ordered according to the de-interleaver defini- 
tion. Decoding continues until the desired number of half 
iterations have been performed. Data decisions are made on 
the final a posteriori probability estimates. 

FIG. 4 illustrates an alternative exemplary embodiment of 35 
a turbo decoder system according to the present invention 
wherein the received samples are modified, or converted, in 
a function block 130 before being provided to an interleaver/ 
de-interleaver block 132. The order of functions (i.e., modi- 
fying and interleaving/de-interleaving) is not critical and 40 
may be varied depending upon the application. 

While the preferred embodiments of the present invention 
have been shown and described herein, it will be obvious 
that such embodiments are provided by way of example 45 
only. Numerous variations, changes and substitutions will 
occur to those of skill in the art without departing from the 
invention herein. Accordingly, it is intended that the inven- 
tion be limited only by the spirit and scope of the appended 
claims. 
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What is claimed is: 

1. A turbo decoder system, comprising: 

a plurality M of turbo decoder modules, each for decoding 
a maximum code word size corresponding to N infor- 
mation bits according to a MAP decoding algorithm; 

interleave/de-interleave-and-convert-data (IDC) circuitry 
for receiving input data samples having an (M-N)-bit 
block-length, the IDC circuitry segmenting the input 
data samples into M segments, the IDC having prede- 
termined interleaver and de-interleaver definitions 
therein, each respective segment being provided to a 
respective turbo decoder module which provides as 
output a posteriori bit probabilities based on the respec- 
tive segment of input data samples, the IDC circuitry 
re-ordering and modifying the input data samples based 
on the a posteriori bit probabilities, the IDC circuitry 
providing the re-ordered and modified data samples to 
the turbo decoder modules for a predetermined number 
of decoding iterations. 

2. The system of claim 1 wherein the a posteriori bit 
probabilities are re-ordered according to the interleaver 
definition upon the end of odd-numbered half iterations and 
according to the de-interleaver definition upon the end of 
even-numbered half iterations. 

3. The system of claim 1 wherein the interleave/de- 
interleave functions of the IDC circuitry occur before the 
convert data function. 

4. The system of claim 1 wherein the interleave/de- 
interleave functions of the IDC circuitry occur after the 
convert data function. 

5. A method for turbo decoding input data samples, each 
input data sample having an (M N)-bit block-length: 

segmenting the input data samples into M segments, each 
respective segment being provided to a respective turbo 
decoder module which provides as outputs a posteriori 
bit probabilities based on the respective segment of 
input data samples; 

re-ordering and modifying the input data samples based 
on the a posteriori bit probabilities for a predetermined 
number of decoding iterations; the input data samples 
being re-ordered according to an interleaver definition 
upon odd-numbered half iterations and according to a 
de-interleaver definition upon even-numbered half 
iterations; and 

making data decisions based on the final a posteriori bit 
probabilities. 

6. The method of claim 5 wherein re-ordering occurs 
before modifying upon each half iteration. 

7. The method of claim 5 wherein modifying occurs 
before re-ordering upon each half iteration. 
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